Skip to main content

Connect to destination

This guide lists the steps to connect to your destination.

  • The credentials are encrypted and stored in the ELT Data app.
  • The connections can be deleted/revoked by the users.

Azure Blob, AWS S3, Google Cloud Storage​

By default all the data is written to your cloud storage accounts. ELT Data follows Medallion Architecture and places the:

  1. Bronze folder: Incoming raw data is placed as it is into the Bronze folder.
  2. Silver folder: Deduped, flattened and quality checked data is written into "silver" folder. The data is written in Delta format.
  3. Gold folder: The business level aggregates reside in Gold folder and ELT Data doesn'twrite anything into folder.

Medallion Architecture

Steps​

  1. Navigate to the Destinations tab and click on the "+ Add New Destination" button to add a new connection. Select from the available destinations and fill the form Sources Page
danger

Please note that ELT Data doesn't validate the correctness of the credentials.

info

If your database is running in private subnet, please make sure it is accessible by the servers running the data pipelines. The databases need not be public or open to external tools.

DB destinations and file formats​

File formats​

In addition to generating files in Delta format, ELT Data can generate files in other formats as well including:

  1. Parquet
  2. Iceberg
  3. CSV

DB destinations​

ELT Data can write to all the SQL Alchemy supported destination listed here. The most commonly ones used are:

  1. MySQL
  2. PostgreSQL
  3. AzureSQL
  4. Snowflake
  5. Microsoft SQL Server